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(54) METHOD AND DEVICE FOR LEADING INTERACTIVE LANGUAGE LEARNING 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide method and device for leading interactive 
language learning. 

SOLUTION: In the method and device for leading the interactive language learning, a 
text file for processing is displayed, the basic functions for interactive learning are 
provided, an animation of a face is displayed, and a work space for a language 
construction function is provided. This system is provided with a set of language 
rules stored as part of a text/voice conversion sub-system, and another set of 
stored rules applied to a process for learning the languages. The method realized by 
this system includes a step for converting the text to an audible voice, a step for 
supplying the audible voice to a user or a student (together with an animation image 
when selected), a step for prompting the student so as to repeat the audible voice, 
a step for comparing the repeated voice of the student with the audible voice 
provided by the system and a step for providing a student with feedback and 
support, e.g. for selecting a required part and reproducing the audible voice and the 
voice of the student toward the student. 
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*7-yZf6 2 4 |:fcl>t7^^v' a Vd*^:^&4x£o 
6 — 6 2 6 J&*raS£*uS 0 

[0 0 5 4] S^STbtf^ H7©^fy/7 

^^^^7 0 6«c*3V^. $*x5. 
y^7 0 8(d*3V^T, ^^»#^H»*^ ^fy/ 

ix5 0 get-, ^ry/7 1 2K*5V^ iga* s STLfc 

2-7 1 2&KXZtiZ>o ^(OliiU^T ^tcm& 
tt, coaSfi^^y^ 7 l 4{c*5V^-Ci^T-t-^o 
[0 0 5 5] SOT3(^I^ v-^T-Ate, Xr-y-fZ 
1 4fc*5V^T\ «v*&fe«U * 7^3/3 1 6tr*3V^ 

T\ , r ^ ^fe 5 v m± u =i - K 

-f— K^y *j&sfltt&£*x5o *T"y:/3 1 6 tOBffiS 

* ft* 0#^t^1-*w — o(07w-hv<y 

[0 0 5 6] -BI8ttS*iaSS:J: BfiMfflfc^t*. ft^ 
Iw, Z.<D^mS 0 0^77/8 0 2 tC&^T, 

iR£H/c:^f3\ ^7y^8 0 4 fCioV^T. T** hfr 
'^4 7^ b£ix. ^TiyZfS 0 6l-ioV>T. aftd*^-* 

*X, ^T" 5>^8 1 0iC*5V^T, f^rXh^Cjf^^ 
ftj&S&S^n. ^7^/8 1 2iCioV>-C. 7 — *—i/B 
Vd**0fS*iX. X?y-?B 1 4iC*5V^T. ¥5*J&*W*£ 
Jx* 1 6 {^ioV^T. T^* — ^d«Kl3&^* 

*X5 0 Set-. ^77/8 1 8t-*5V^X. M^Ttt 

4-8 1 8i*KaS*t6. iBaA 5 ^TL-CV*54§'frJ±. 
KTyrf* 2 0(C*5V>Tw^>ifiSttl*T"t"6o 
[0 0 5 7] 77^8 0 2t£*5V*T^fej&*»tR3ixfc 
^fy^8 2 2|C*>V^, IffeSax*^*^* 
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Six. ^^y^8 2 8tCioV>r. ^CO^J*. i"ftfc> 

«#*Jxfc*WS*SlxS. *lw. ^7^8 3 

TftV**frfi. ^fy^8 2 2 — 8 3 0^tt9 i££ix 
S„ ^co^^^T Lfc^te. *t^:/8 3 2M*5 

[0 0 5 8] @#co^^^if(7j>aSft^^^ 
A'** t — Sri" 5 a>£r*fl 6 fc fcldffffi-f" 6rt SriBRf 

Sfc^icte, g|b#;*Btt (3g/*o&lE) *5 

Aft BE (V I V) ^^-^3 0, 3 

2, 3 2a (feit^BBa-J-SS*) ttt^-fr^Tfflv^ 

js^rtt, "p" t b b" fe5v^^i "t" t "d" te¥ 
eo«Sf*d«BW'J*ix6o IE5iSO^ = r y - 
JxfjR^Slxsto-cttJfcv^^. Mi iro^7t- 

= T*«$*ixSo 

[0 0 5 9] ?^©7-f- K^y *te«*fc7#3;«r» 
5w^"Ct5 8 rix&7-<-K^y^tt. 

i^ffl.v\5nt!{>< wor^y>— i>-3 xomm^^ 

V^fi, 7r^^fcLtffl*77-f^M i e!l2 6 (mi) 

[0 0 6 0] »*^3TtCtt. (^CCO^/U— A, y 
tt, «MZL tiR, -b», i/-<;i-^. 

• B77^/^ LT^VMbiX^^gS, ^ Offll iZL&fr&X 

40 ?>ixs««. ^^^v-^x^i^f§Lrv^6^i-itx^^ 
£*x3fc<B-ctttt^as, ^/u-7"(cg2jij$n/cM, R^e 

cofdl^— 2 <0 -> > tK^^t ffi v * X y * — > ^ Sr^-t* ^1 

50 u ^^tJ^uttSftSi-s*^*. 2o^u ^ 
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[0 0 6 1] *—*>x\cm-f~Z>'7 -< — Y'<v9 
a *K «liLtf, VIV«S(CJ;otftSSh 

[0062] v^ofc^^sfo5sa<oj«w«ai-s 

ft ±mm\c*> - y/u&»M ZtilthZ* d^A/WSrS 

[0 0 6 3] ^f^^^lWU?), SISSrWttWU 
* h*fflv^5dids-C#<5 0 coy* ML SW7 7>f 

ht>**> («l*.tf. A^y^2 0^Lt) ffffi-J-Sw 40 

/^ot,^tm#lc^-H, f7t/uhtL JO 

-10- 
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fcSiMi?— K (*>5v>f±^yu— hi* 

*«ffl#»^£;h,5o !7-^*^-*$StEte. 
££3^T v f-:/!7-K. 17- K. fe^V^tt^u—^SrMf 

[0 0 6 4] *£j&*^«*J**3<fct*?-<'— K^y^dtu 

^^^5 0 wCOffl^^rc^-^J^ LTtt, "T r y 
this... in the word 'gradu 
ate' the *d* is pronounce 
d wit ha j ' sound as in * j 
a r * (C*b«rK^.-CTS V\ ^if 'gradual 
e' (C*5ltS 1 d' tt. 'jar 1 KfcttS ' j ' * i 

OT, M$iiW^-K, 17— K, ifoSV^tt^u- 
[0 0 6 5] * y-fe — i/*i^^^A(Ci:oT^^ hfb^ 



19 

[0 0 6 6] 3§^±0^7— l^Bli-SI^I-fr bKTV^S 
^i^^$:^g^-^fc^(cffl^6^5o ffiJx.fi. %H 

*U"0^5 0 "Try this..." y * — V* 

■Cl^«^H^5o ffiJx.fi. 8177^^4 4 
— ^«:$«>S^ tfc-C#2> 0 ffiJx.fi, !7-Kt^K 

&K£^x.S*:#>t;:, m~<Dmm<D^-^^-Y\^^\f 
^^ZtiZ. Stic, f^!7- Kx— zA^/lv^. * 

»*J*«-C#-6J: 5ic#oT^5o -ffiJ^LT. 

y Tt Lt, ffiJx.fi, "a 1" Sv^^-Y 

'balk', 'talk' , *5<fcU< 'walk' 
^£*L5 0 jfe****tt*K*. ^£li, C*b<b*f§£l$ 
S-r-5o 3*£fi. Wg^(D7t<D^7y- h\ V 

[0 0 6 7] ^£fi, ifc*t£rffit^*— KlCTl^f6 
^t^ttSo wttfc*— Kicli. ffijx.fi. 

as '.mftt^u^yh ^uv^k 

[0 0 6 8] ^77^^^7^hU- 
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[0 0 6 9] ?i^7^-vy7C0^37!J 
W y h i LtOftlB^arCS^V^ftftSJxS, ffiJ 
/u*»a65fc*. $>5i^fi, y TZ&Zti 

£>\zm\<^btiZ> 0 £<bfC, »**7*0«*fc$MftW< 

^^oma a» e> flti£ * * 7 * co ^ k £ 
[0070] ¥±(D^p(Dx=<Tte^ y-zfv— KitMft-c 

^37^»6CH, fcSV^fi : g : ^^^^^= I T$r 

[0071] ip^otftSE^BB-i-s jEftftraHtt>r 7 

^XWE&m&k^ ttBEiaa*i^^7>f hS^fc^^r^.h 
[0 0 7 2] fe-5^x.ibnfcmfi^|!E^P^i^7 f y--Kfo 

40 [0 0 7 3] nbtltl^— *^>r ^* = 7tt, "r—^lV 
(ffiJx.fi. ISIl 607^— ^/U5 2) f^i-|E^:^iXSo t" — 
^5 2fl, «/r*JKfi*»5^i:dS-C#, 

[0 0 7 4] ^f±, $<b(C. ^7 7^;^-^^ 

50 mmztti-zfflmz&j£&z>)<^*®*E-tz>zt&x% 
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[ 0 0 7 5 ] 12 9 fi. ^^d5C<0^$rtT/«f otztb<D— 
-d<D& £ LV^ft^^-f- 0 ^;*?£9 0 0te, ^fy^ 
9 0 2ld*3l>T. ^^^SiJ#-^$rA^|-rSCi:^i:o 
X&fj^i^So *^s>^9 0 4lc*5V^X. 
^/^ffffi^ix, Xry79 0 6f:i*5^X. ^^r^fB 
fikSix. 0 8 K:*$^X. 

ffi«£Jt, 1 0tc*3V>XiliR£;h,*:t'y* V 

[0 0 7 6] Hll Of*. ^fy^9 0 4 tdJottS 
»ftu-<7USrSffii-5iaeSr*fel 000£LX«fc9l£ 
^3(-^-r o ^Oiim^^^^^l 0 0 2IC*5V^T, %— 
<D'<=7 f^yft^^Zfo, XT 0 0 4tCioV^T. 

^«-^ s 7^7 7^, ^^5/^1 0 0 6(^*5 

T'lOOSlCjo^T, ^7^7 74*//<7^7 7©S 

0 10lc*5^X. f-//^^t?>Ci:^ f&fcftfc: 

x.jfcvMfrfrtt:. ^ry7 p l 0 1 4K:*5^T. 11;^^ 

[0 0 7 7] ^-^°7^7Z^^$tbfc^fi, * 
0 1 6(^t3V>T, ^^^-0/^7^7 7$:^ 
3k ^ry/l 0 1 8ic*5^X, «« W^J&SSISS 

^fy^l 0 2 0»^, /<7^774ft:/t^ 
^7^7^(C»i-5^3Td*»P>ttS. ^^10 2 
2fc*3VvT\ f?T>\ ^sSt^r-y^/^x, *»*>SV^ 

0 2 4lc:*o^x, — y/^bW&jfrfc^^TdSBT 

[0 0 7 8] mi lfi, 7, s rv'f9 0 8fc*3it5 U'y* 
9 1 0 {Z&tf&UyX^VX^T V ls#\Z.n 

0%^-6^^T$:^o 0 ^77/1 1 0 2 1^*3 

**f§l-*ri-5wixP>^ = TA»?), MC^Lt, <^<7> 

£*l5#IX(i. *fg "f ox" fi, fcort:5 0%*S* 
=3T«rgtf\ ZCDtibb, XTv-fX 1 0 4 tdiSV^X. * 

i§ "fox" ir»u-c*p>tes^^ h^ffi^ixSo & 

"fox" W^^^lr^t^^^ 
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;ft,5t><D£ LTftSSit. 1 0 8^*3V^X. 

U7^^fc*()i:, **b-eh,* a f £ "x" cow^-g- 

ill OlcioV^x, ^fy^l 1 0 2Ki:Jott5&#J(7>:fc: 

"j uraps" „ "1 a z y " ^ fciO 5 "dog") 1^. 
»LT, KJ-y-fX 10 4 — 110 8tH-OB^E 
m^ixSo ^77/1 1 1 2(d*5V^X. #S&SU£ 

X, &&frt*to#&%ktf^i£**ftvtth LtM^ 
^777'1 1 1 6tc*sv>X. uy^^^ 

[0 0 7 9] #3BWI-J:a$'*7 i A*3J:U<*«fert:* ^< 
^^^ig$:«a^^it-5C^X% ¥^<Dtiit><Dm 

■&*{c£^5< Uy^^oa*ii:j6«ffiSc$ix-Ct^5o 7c/c 

94-14 2^mui-^mx^yv ^^^T^ti^ 

[0 0 8 0] »*T-e^*ff* (Directed 
learing experience) — S^W^^ 

[0 0 8 1 ] ttScW^Bl&tf^^Tft^ (Listen 
to any word) -*T*X b/^l&&&8Lm 
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*f , £>£V>fi— ^" xmUfrb^M?-** h (c 1 o s 
ed captioning text) $rlIZ^"f"6 -1 

[0 0 8 2] y ^^y^3y/!JAyi/ 3 y (List 
ening comprehension)— T^^^h 

<D y < 7 * — v ^ * £ fa _b £ * £ it tf> I £ © £ jft, 3 0 
[0 0 8 3] )|jSt7 P Dy7 P h (Example an 
d prompt) -v-*^ V<n*r*7s 

[0 0 8 4] MIS, T'nV^K ft« (Ex amp 1 
e x p r omp t , record) — ^ T" A f i ^ Ctl 

— K, 17- 7U»^^ft5@#^ 

[0 0 8 5] ^nVT'K W£ (Exam 

p 1 e, prompt, record, playbac 

k) -v*7^te s tftbmmzf&^&ttzz tx\ 

-5 <fc o KIM K • • iM K^ffi^i"* fcfcez>^«& 

[0 0 8 6] S#-ea«-e#5*i* (Self-sel 
ected reinforcement) — 3£^fe£ 5 $F 

r * -fe *1"6 ;l £ # T- 1 * 0 ^£fi> 

rAlt "Try this. . . ( C*u«rf* LtT^ 
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[0 0 8 7] :/n ^ k *fc«. e 

WzVy^kifz (Example, prompt, recor 
d , playback, compare, displa 
y r e s u 1 t s) - KXr A©»«|g«r8^«lcgffl 
•*--5^Ji:U-C, 53te*<B«M& 

* - ^ * <d m ^ * if Ht ffi «: -fr 5 w £ . "C # $ o 
[0 0 8 8] ^C^^ (G r a mm a r skill 
s) -!7— KftiSS* (^o^A) coiiaDKJ: 9, f§ 

20 I? - Ktel/o^iH©^*^ Lt, X(OmX^- 

fflv^r*fioRfeioftfiiJ(r»^v^r«ia$HS "Try th 
is..." oihVTV^&ffrS-j-So raJSffl«**-h5*oj;3 

[0 0 8 9] ^^^^f^coS^cco^^l^^^C 
jo l^i^-ttsctt% ftfett, coffin, ifeWtD 

£5o ^ICtoTfi, PL 9 4- 1 4 2l;WUci 
40 oit^»»t5^t!& J tf6o C<7>*tfiEfi, 

y tf ^ h n m-f¥$i\^ tort *aE-c*>*. 

[0 0 9 0] R^^Si-SBS^tt, •WttttH'tfeS 

50 ^m^ZW^lTZZ. t #-C* 5c 
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[0 0 9 1 ] ±ifc<0KWrt\ *fc#38HO»S£*JBSM 




1 


4 








1 


6 


A^-rX-Y * 






1 


8 








2 


0 


A^y >^ 






2 


2 








2 


4 








2 


6 




[131] ^W-££v^7^c0^(3T-&S o 




3 


0 


T^^h/*^*! (TTS) ^e^a 


[112] *«IBlcJ:5»Bffl^«Ofc«)Jcfert*Jx5* 




3 


2 


e»*j*»lR (ASR) 




70 


3 


2 


a *7»tiratfeBE (V I V) gP53r 


[SI 3] **WI-J:§*«feo«B«r^i-«8^IS-Cfe5. 




3 


6 




[SI 4] J: ttfcf 1 *;* U 




3 


8 


v * Jxfc* J* 77>f^ 






4 


0 




[15] *38W IC J; S*iSfe(-*3 ttSx** h^iliRU 




3 


4 








4 


2 








4 


4 




[HI6] *»MicJ:S*ffi^*5tt6«*i-5igaoff«l 




4 


6 








4 


8 




[[§17] *^ ^ ti i §^i£i:i3it t ^ - o(0^ 




5 


0 






20 


6 


0 








6 


2 








6 


4 




[in 9] *»wtc«ts*jsfei^*5tt6^^aft"i-siaa 




6 


6 




&*+Sfch,E|-e*>5 0 




6 


8 








6 


8 


a' VSmtffi - 


(t?8»OB« oaaS:^i-8KtbHt?ifoSo 




6 


8 




[Ell l] **^o*-«fe(cJ:5^=ir y ^^HftlS:^ 




6 


8 


c ffit#*>- 






6 


8 


d 


[ff*ottW] 




6 


8 


e flciksK*!' 


i o tt&sm¥tam~>xT* 


30 


6 


8 


f m^tf*^ 



1] 



A* 



f*&/w U30 1 «a5 U36 



10 



— 14 



*40 



9— F — 43 



^32 



n_ 



BR© 



as 
tag] 



-46 
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6Bo 



\2)' 




5EEZ 



«4 





/68c f66d ^8* |68f 

O (sl [2 □ 
f$jt w± t*jt a* 



[03] 

— ^ — 



X 



302 
304 



[IS 7] 
B6frS 



i- _ 



702- 



^LlCg^g-frfftteTSl 312 



I 



T 



3 , 



I 



i 

| gg^x^fTI — 70S 




[ES4] 




400 



I" TrO^&Rtl I 408 

i 



1 



yW&H % A'*>\Z&.7frt 4 ^- 410 

| S£tf»>Eft-r | 412 

414 




41 fetors 



. 












420 








** 




502- 

504- 

506- 

508- 
510- 
512- 
514- 



Jtasgfissts 



X 



i 



X 



J 



1 gftPfrfegft&iKTft | 



500 




-15- 



(16) 



ftffl 2001-159865 



[126 ] 



ims] 



602 ^" CglfrBfrfrg«flTr) 



604 




iSL. 



606 



603— 




r 



-612 




620 



> 1 »afr?iysrs 



E 




[09] 



900 



J— 904 
] — MS 
"I — 908 



x 



J- — 910 
3 — 312 




[mi o] 



I 



X 



>-1006 



— 1008 



— 1010 



J — 1012 
1014 



»±tf»-g>/^77ft%W^ 1016 



I 



J — 1018 



I 



X 



— IQ22 



g=. gga-^w 77Crj i*r ± acDAw^ggra |— 1 024 



-16- 



(17) 



2001-159865 



[121 1] 



1100 



DC QUICK BROWN FOX iUfPS OVER THE LAZY DOCS TAIL 
ft t t 



FOX JUMPS LAZY WS 

I 



1 



2118: 



•1102 



— 1104 



— 1106 



I 



I 



— iioa 



] — 1110 



>-1112 



1 &&Mt<nttttt)&*temmiz-oi*Ttfrmtz 



— 1 1 1 & 



P -r— 27U 


1 


50 


40 


90 



(51) Int. CI. 7 
G 0 9 B 



G 1 0 L 



5/14 
15/00 
19/04 
19/06 
13/00 
21/06 
15/00 
15/28 



F I 
G 0 9 B 



G 1 0 L 



f-73-K 



5/14 
15/00 
19/04 
19/06 

3/00 



R 

S 

5 5 1 E 
5 7 1 H 



(72)3g^# +7 4 is -fJvttvY 

T*])$&$tm 07747 — &<y — > 
-4 , !7 V, T^— ^ cr — K 33 

(72)%^# bT-. y 

1) *>&$tm 07974 — i^-v — 

225 



(72)3§9i# -7>f>5r/u ^3/*^- ~- 

T*»*&mm 07728 ~:x— S^-v— f 

159 
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(18) 

(72)|§2J# ^ V > >- 

T * y *><&$tm 07922 — — 

150 



4#|P12 001-159865 
(72)$g^# 7?y ^*-WK7-fe^7> IM^K^ 

r^y^7^*s 08904 s**— f 
(72)^^# ^ryy y>-^ 

T * l) X^&m 07922 — v^— : >- 

*w /^y, *y — 

^i/y u— > 49 
(72) */u 

T^y^^g 07076 — i^— v- 

D - h 558 
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